Papers with Natural language Inference
Reading Comprehension as Natural Language Inference:A Semantic Analysis (2020.starsem-1)
Copied to clipboard
Anshuman Mishra, Dhruvesh Patel, Aparna Vijayakumar, Xiang Li, Pavan Kapanipathi, Kartik Talamadupula
| Challenge: | In recent past, Natural language Inference (NLI) has gained significant attention, but its true impact has not been well studied. |
| Approach: | They propose to transform a large RACE dataset into an NLI model and compare it to a state-of-the-art model. |
| Outcome: | The proposed model outperforms the previous model on a question-answer concatenation form and a coherent entailment form. |
FENICE: Factuality Evaluation of summarization based on Natural language Inference and Claim Extraction (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in text summarization have shown remarkable performance, but a significant number of summaries exhibit factual inconsistencies, such as hallucinations. |
| Approach: | They propose a factuality-oriented metric that evaluates text summarization for accuracy . they use a human annotation process to examine the accuracy of automatically generated summaries . |
| Outcome: | The proposed metric sets a new state-of-the-art on AGGREFACT, the de-facto benchmark for factuality evaluation. |